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-Abeeraetv-^The  paper  presents  a  unified  approach  to  the  design  of  stable  adaptive 
algorithms  for  hybrid,  discrete  and  continuous  systems  which  have  two  time  scales. 
Hybrid  error  models  are  first  analysed  in  detail  using  two  distinct  approaches 
and  the  results  are  extended  to  discrete  systems  in  which  the  parameters  are 
adjusted  at  rates  slower  than  those  at  which  the  systems  operate.  The  algorithms 
developed  when  applied  to  the  adaptive  control  problem  are  shown  to  result  in 
global  stability.  Simulation  results  are  included  and  reveal  the  dependence  of 

the  convergence  rates  of  the  various  algorithms  on  the  two  time-scales.  ^ - 

Introduction:  In  the  past  few  years  several  continuous  [1,2]  and  discrete  [3,4] 
adaptive  algorithms  have  been  developed  for  the  stable  identification  and  control 
of  linear  time-invariant  plants  with  unknown  parameters.  In  continuous  adaptive 
systems  the  plant  operates  in  continuous  time  and  the  controller  parameters  are 
adjusted  continuously.  Similarly,  in  discrete  adaptive  systems,  the  various 
signals  as  well  as  the  control  parameter  vector  are  defined  at  discrete  instants 
of  time.  However,  practical  adaptive  systems,  for  a  variety  of  reasons,  may  not 
be  either  purely  discrete  or  purely  continuous .  For  example,  recent  advances  in 
microprocessors  and  related  digital  computer  technology  favor  the  use  of  discrete 

f* 

controls  even  for  continuous  systems.  Such  systems  are  now  referred  to  as  hybrid 
control  systems.  Further,  even  in  purely  discrete  systems,  the  computational 
effort  involved  quite  often  necessitates  the  adjustment  of  the  adaptive  control 
parameters  at  rates  significantly  slower  than  that  at  which  the  system  operates.  it 
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Both  hybrid  as  wall  as  discrete  adaptive  systeas  of  the  latter  type  can  be  con¬ 
sidered  as  systeas  with  two  tiae-scales.  Recently,  continuous  algorithas  of  an 
Integral  type  have  been  suggested  in  the  literature  [5]  which  can  also  be  inter¬ 
preted  as  belonging  to  this  class.  This  paper  proposes  a  unified  approach  to  the 
analysis  and  synthesis  of  such  systeas. 

Gawthrop  [6]  was  the  first  to  Introduce  the  concept  of  hybrid  self- tuning 
controllers  which  are  partly  realised  in  continuous  tiae  and  partly  In  discrete 
tlaa.  In  [7]  Elliott  presented  a  method  for  the  Indirect  control  of  hybrid  adaptive 
systeas  and  aore  recently  Crlsti  and  Monopoli  [8]  attempted  the  direct  hybrid 
control  of  aodel  reference  edaptive  systeas.  The  central  question  in  both  cases 
is  the  global  stability  of  the  overall  systea  which  can  be  best  analysed  by  con¬ 
sidering  the  behavior  of  the  corresponding  error  aodel.  The  main  contribution  of 
this  paper  is  the  detailed  analysis  of  several  error  nodels  using  two  distinct 
approaches .  The  insights  obtained  by  this  analysis,  as  well  as  the  specific  results 
derived  provide  valuable  tools  for  the  synthesis  of  stable  adaptive  controllers  for 
general  two  tiae-scale  systeas  sad  for  hybrid  adaptive  systeas  in  particular. 

In  section  2,  using  a  Lyapunov  approach,  different  adaptive  laws  are  developed 
for  the  various  error  aodel s  which  assure  the  boundedness  of  the  paraaeter  error 
vector.  Conditions  under  which  the  output  and  paraaeter  error  vectors  tend  to  zero 
asymptotically,  are  also  derived  end  are  particularly  useful  in  the  identification 
problea.  The  aain  result  of  this  section,  which  is  aost  relevant  to  the  control 
problem,  relates  the  rate  of  growth  of  the  output  error  to  that  of  the  norm  of  the 
input  vector.  While  this  result  is  comun  to  all  the  error  aodels,  the  method 
of  proof  used  in  each  case  is  found  to  be  significantly  different. 

Applications,  extensions  and  modifications  of  the  adaptive  algorithas  are 
treated  briefly  in  section  3.  The  principal  steps  in  the  proof  of  global  stability 
of  a  hybrid  adaptive  control  systea  are  first  outlined  in  section  3a.  The  seas 


algorithms  whan  suitably  modified  are  also  shown  in  section  3b  to  be  applicable 
to  both  discrete  and  continuous  systems  with  two  time-scales .  Finally,  in  section 
3c  it  is  shown  that  the  use  of  time-varying  adaptive  gain  matrices  (as  in  the 
wall  known  recursive  least-squares  approach)  in  the  algorithms  does  not  affect  the 

stability  arguments  of  the  earlier  sections. 

Section  4  contains  detailed  simulation  results  of  different  error  models. 

The  speed  and  accuracy  of  the  various  algorithms  are  compared  for  different  values 
of  the  period  T  during  which  the  control  parameters  are  constant.  Approach  1  is 
found  to  be  better  for  small  values  of  T  while  approach  2  is  significantly  better 
for  larger  values.  A  convex  combination  of  the  two  schemas,  which  can  also  be 
demonstrated  to  be  stable,  is  suggested  as  a  viable  alternative  for  most  adaptive 
systems. 

2.  Error  Models: 

The  dynamical  systems  discussed  in  this  section  are  continuous  time  systems 
in  which  t  c  JR+,  the  set  of  all  positive  real  nta&ers.  Let  us  ffc+  and  e^: 
be  piecewise  continuous  functions  referred  to  as  the  input  and  output  factions  of 
the  error  models  respectively.  Let  {t^>  be  a  monotonlcally  increasing  unbounded 
sequence  inft+  with  0  <  T^w  <  <  Imi>  <  •  for  k  e  H,  where  Tfc  is  defined  as 

•  tj^j  -  tfc.  When  tfc  ■  kT  (or  Tfc  •  T)  we  shall  call  T  the  sampling  period.  Let 
+:  |R+  •►JR®  be  a  piecewise  constant  function,  referred  to  as  the  parameter  error  vector 
and  assume  values 

♦CO  -  t  c 

where  4,  is  a  constant  vector.  The  error  models  described  In  this  section  relate 
k 

the  output  error  e^,  the  input  vector  u  and  parameter  error  vector  4  in  terms  of 
algebraic  or  differential  aquations. 
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The  first  error  model  Is  described  by  the  equation 


♦k  uCt)  -  e^t) 
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It  Is  asstawd  that  («ad  hence  is  unknown,  the  values  u(t)  and  e^(t)  can 
be  observed  at  every  Instant  t  and  A$  ^  -  ♦.  can  be  adjusted  at  t  •  t  . 
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The  objective  Is  to  deternine  an  adaptive  law  for  choosing  the  sequence  {A$k> 
using  all  available  Input-output  data  so  that 


11a  e,(t)  -  0. 


Consider  the  Lyapunov  function  candidate 


V(k)  -  1/2  4k+k 


AV(k)  -  VOD  -  VCk) 

T 
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Choosing  the  adaptive  law 


i  /Sef  1  •1(t)u(t) 

"  *  T\  —  T - dT 

k  Tk  ^  1  +  u(t)uCt) 


yields 


"«  *  -  2  Vk 


where  Is  the  synastrlc  positive  seal-definite  aatrlx 


*.  ■  A.  (tfcfl  -X&f.W. —  dt 
k  *k  *  t.  1  +  uT  (t)u(t) 


with  all  Its  eigenvalues  within  the  unit  circle.  Since  [21-R^l  >  01  for  tone 


.w,  w. 
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constant  0  >  0, 


AV(k)  <  -  y  6^kTRk^k  *  0 


C7) 


Hence  VCk)  Is  s  Lyapunov  f motion  and  assures  the  boundedness  of  ||  $k(  If 

00 

bounded.  Further,  since  (AV(k) }  Is  a  non-negative  sequence  with  I  AV(k)  <  •  It 

^  k-0 

follows  that  dV(k)  •+•  0  as  k  -►  •  or  alternately  fron  (7)  tk  ^^k  ♦  0  u  k  ♦  *.  This 
can  also  be  expressed  as 

dx  -*■  0  as  k  (8) 


1  [tfcfl  *i  (t) 

Tk  J  tfc  i  +  uTcx: 


COuCx) 

Case  Cl) :  If  u  Is  uniformly  bounded  In  (R+  it  follows  fron  Cl)  that  e^  Is  also 

•  2 
uniformly  bounded.  Since  1  AV(k)  is  bounded  we  have  fron  (8)  that  e.  t  L  .  Further 

.  k-0  1 

if  u  Is  also  bounded,  then  11m  e.(t)  -  0.  Hence  for  a  uniformly  bounded  u  with 

a  m  If  only  bounded  derivative,  e^  tends  to  sero  and  A*k  +  0  «  k  +  «. 

Case  (11) :  If  in  addition  to  being  uniformly  bounded  u  Is  "sufficiently  rich"  [9] 

over  an  Interval  Tm-in,  so  that  the  matrix  ^  Is  positive  definite  for  all  k  e  H, 

then  AV(lc)  <  0.  Hence  the  parameter  error  vector  tends  to  sero  as  k  ♦  •  . 

Case  (ill) :  A  more  interesting  case  arises  when  u  may  grow  at  most  exponentially 

and  is  relevant  to  the  control  problem  (see  consents  at  the  end  of  this  section). 

Since  condition  (8)  Is  Independent  of  the  assmption  of  the  boundedness  of  u.  It 

follows  that  *1  £  If  the  Input  satisfies  the  conditlontyu||$  M^||ug+ 


A  +  u^u 


for  s 


constants  and  Mj, 


id  hence  grows  at  most  exponentially. 


A  +  uT(t)u(t) 

has  a  bomded  derivative  and  the  Integrand  In  (8)  tends  to  zero  as  k  •.  Hence 


9.  uCt)  •  e.(t)  -  o{sup B u(t)|] 
*  tax 


(9) 


or  e-  grows  slowly  [1]  coopered  to  the  norm  of  the  input  vector  u.  Equation  C9) 
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plays  a  central  role  in  the  proof  of  stability  of  the  hybrid  adaptive  control 
problem  and  is  discussed  in  section  3a  . 

Approach  2:  In  this  approach  the  error  equation  (1)  Is  modified  to  the  equivalent 
fora 
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♦  Te  (t)u(t)  -  e  2(t)  t  e  [t  .t  ) 
k  1  1  k  kH 

keH 

by  multiplying  the  two  sides  by  e^(t).  Integrating  over  the  Interval 
yields: 

tk+l 


(10) 


f  kfl  /  k*l  , 

♦  *  I  •1(T)u(T)dt  -  e.  (T)dt 

k  )+  1  Jt.  1 


T  |  ...  _  [  **’*  2 

St  -k 

or  equivalently  the  discrete  error  model 


where 


♦k  «(k)  -  e(k) 


/Vl  A  rVl  ; 

j  e1(T)u(1f)dt  •  «(k)  and  j  e ^ 

St  St 


Cll) 


2(T)dt  S  e(k). 


For  the  error  model  Cll)  the  adaptive  law  for  updating  4^  can  be  written  by 


Inspection  [3]  as 


_ 

k  1  +  w(k)  »(k) 


(12) 


From  well  known  results  In  discrete  adaptive  control  [3,4]  It  also  follows  that 
(1)  |  4k||  is  bounded  if  (|  4q1|  bounded 


(11)  «*■  0  as  k  •+■  • 


and  (111)  |e(k)|  ■  o[suptyu(v)l  ]  or  e(k)  grows  more  slowly  than  «(k) 


k>v 


Case  (1) :  As  in  approach  lt  If  u  la  uniformly  bounded  in  (R  ,  e^  end  hence  e(k) 
and  w(k)  are  uniformly  bounded  for  all  t  t  R+  and  keH  respectively.  If  lu[lis 


also  bounded  11a  e^(t)  ■  0. 
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Caae  ( 11) :  If  In  addition  to  being  uniformly  bounded  u  is  sufficiently  rich  over 
an  interval  T  .(  k^u(x)u*(x)dx  -  P,  is  positive  definite  for  all  k  e  N.  If 

,  Tminjtk  [vVk]Z 

V(k)  -  y  the  adaptive  law  (12)  results  in  AV(k)  - ^ — 2  <  ®  ^or 

1  +  ^k  Pk 


♦,  i*  0  and  k  e 
k 


Hence  0  as  k  09 . 

k 


Cage  (ill) :  Aa  in  approach  1,  the  case  of  greatest  interest  arises  when  u  e 

u  f  L  and  grows  at  most  exponentially.  The  condition  |e(k)|  *  o[sup§ “(vjft]  can 

k*v 

be  equivalently  represented  as 


/Vfcl  2  M 

J  Ae1  (T)dT  -  o[sup|  |  ®j(x)u(x)dx  R]. 


(13) 


k»v 
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Equation  (13)  implies  that  a  sequence  (B(k)>  exists  with  3(k)  i  0  ?  k  £  N  and 


B(k)  +  0  u  k  +  ",  such  that 
ffckfl 

J  |*1(T)|l!e1(t)|  -  6(k)  ||  uCt)(  ]dt  -  0  VktS 


(14) 


ew  j 

Since  e^x)  •  uCx)  ,  x  e  and  is  bounded  (14)  can  also  be  written  as 


fSrt-l 


|  Te^x)  !  ft  u(x)|  [v(k,x)  -  6(k)]dx  -  0  V  k  e  N 


(15) 


where  v(k,x)  |  cos  w^CO  I  and  is  the  angle  between  the  vectors  and 

u^Cx)  for  x  e  [t^t^).  Since  6CW  +  0uk  +  «,^  v(k,t)  is  bounded  and 
v(k,x)  >  0  for  x  e  it  follows  that  v(k,x)  -*•  0  as  k  •  which  in  turn 

Implies  that 


e.(t)  -  *.Tu(t)  -  o[sup*uCT)H] 

A  *  tii 

which  is  the  same  as  (9)  derived  using  approach  1. 
b)  Error  Model  2: 

The  second  error  model  is  described  by  the  error  differential  equation 


(.16) 


•  ^  T 

e  ■  Ae  +  b9  u 
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wherc  e(t) ,  b  e  R°,  A  e  Rnxn  and  is  stable,  (A,b)  is  controllable,  ♦(t) ,  u(t)  e  R™ 

and  *(t)  -  4.  t  t  e  [t.  ,t.  , ,) ,  k  e  N  where  4,  is  a  constant  vector.  In  this  case 
k  k  W-l  k 

the  parameter  error  vector  is  to  be  adjusted  using  the  input  u  and  the  state  error 
vector  e.  Since  A  is  a  stable  matrix,  a  symmetric  positive  definite  matrix 
P  »  P^  >  0  exists  such  that  A^P  +  PA  «  -Q  <  0. 

Approach  1:  Using  this  approach  error  model  (16)  is  first  modified,  as  in  the 

T  T 

continuous  case  [1],  using  a  feedback  term  -Yu  ub  Pe  to  the  form 

e  ■  Ae  +  b[$Si  -  YuSibS’e]  (17 


The  corresponding  adaptive  law  is  the  average  gradient  obtained  in  the  continuous 
case  over  one  period  and  is  given  by 


6$. 


Defining  the  Lyapunov  function  candidate  as 


1  'tfcfl  T 
-  “  “  I  u(T)bTPe(T)dr 


(18 


T(k)  *  t  *T<ck)p*<tk)  + 


(19 


AV(k)  -  - 


Stu  T  iv  /  Htn 


/  T 

f  ex(T)Q«(t)dr 


J  t 


-  (  1IeT(T)Pb]2uT(T)u(r)dt 


HI 


t 

Sc 


kH  T  II 

e  (T)Pbu(T)drJ 

t 


max  J  Sc 
2 


(20 


1/T  j  ttx(T)|2dt  *  [1/tU}  «Ct)dr||]: 


Since  for  any  vector  x(t)  6  R 

t-T  t-T 

the  second  term  on  the  right-hand-side  of  equation  (20)  dominates  the  third  term 
T 


for  all  y  *  3==  .  Hence 
imln 

AV(k)  J  0 


V  k  c  N  and  Y  i 


2T 


(21. 


min 


This  implies  that  11  and  l\e (t^) ft  are  bounded  if  J  and  (|e(t^))(  are  bounded  and 
AV(k)  *►  0  as  k  ♦  -  i.e. 

/**«.  t 


rSefl 

k  • 


s*CT)Qs(T)dT  ♦  0  •,  I  ~  "(a\  )Pb]2uT^  4t)dt  -*•  0 

Sc  Jtk 


as  k  4  • 


(22) 
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Again,  since  £  AV(k)  is  bounded  e,[e  Pbju  t  L  . 
k-0 

Cage  (i) :  If  u  is  uniformly  bounded,  it  follows  from  equation  (17)  that  e  is  also 

2 

uniformly  bounded.  Since  e  c  L  this  results  in  lim  e(t)  ■  0. 

t-*» 

Case  (ii) :  As  in  the  earlier  cases  with  error  model  1,  when  u(*>  is  sufficiently 

rich  over  a  period  T  .  ,  V(k)  is  monotonically  decreasing  and  hence  4  +  0  as  k  +  «. 

min  ic 

00  ^  00 

Case  (iii) :  A  somewhat  more  involved  argument  is  needed  when  u  e  L^.u  t  L  and 

T 

grows  at  most  exponentially  to  relate  the  growth  rates  of  u  and  ^  u.  The  exist¬ 
ence  of  the  discrete  Lyapunov  function  assures  the  boundedness  of  e(t)  at  the 


discrete  instants  t  -  tfc.  Since  e  can  grow  at  most  exponentially  by  equation  (17) 
and  since  the  interval  [  t^, is  uniformly  bounded,  e(t)  is  bounded  for  all  t  e  R* 
Now,  the  same  arguments  as  those  used  in  the  continuous  case  [1]  can  be  used 

to  demonstrate  that||w  (s)$*u(J«  o[sup(|u(T)||]  where  W  (s)  «  [sI-A]  H.  In 

T  T  T  tar  ” 

equation  (17)  I<fr  u  -  yu  ub  Pe]  is  the  input  to  an  exponentially  stable  system. 

Since  e’Pbu  e  L2  the  component  of  e  resulting  from  eTPbuTu  must  grow  at  a 

slower  rate  than^  uty  l.e.  o[ sup  R  u(t)(|]  .  If  this  is  unbounded,  then  the  response 

T  tit 

due  to  +  u  should  also  be  o[sup  A  u(t)R]  >  since  we  have  already  demonstrated  that 

t>T  + 

e(t)  is  uniformly  bounded  for  t  e  R  . 

Approach  2:  In  this  case  the  error  model  is  described  by 


e  ■  Ac  +  b$fc  u 


t  C  1^,^) 


(23) 


and  does  not  contain  the  feedback  term  as  in  (17) .  Multiplying  both  sides  of  (23) 


by  e  P  and  equating  the  integrals  over  an  Interval  [t^.t^^) 

*■-  ,Vi 


e  (t)Pe(t) 


+  f  eT(T)Qe(t)dt  -  2  (  T"'~*  T 


n. 


Jtk 


e  (T)Pbu  CO* ,dx 
k 


or 


w(k)  -  e(k) 


(24) 


(25) 


where  l.h.s.  of  (24)  is  e(k)  and  2 
law  may  be  written  by  inspection  as 


/  kf  1  T 

]  e  (T)Pbu(t)dt  »  w(k).0nce  again  the  adaptive 


it. 
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-  e(k)wCk) 

1  +  wT(k)w(k) 


and  yields 


|  e  (k)  |  -  o[suplw(v)B] 
k>v 


Case  (i) :  If  u  is  uniformly  bounded,  from  equation  (23)  we  have  e(t)  and  e(t) 


uniformly  bounded.  Hence  w(k)  is  uniformly  bounded  and  e(k)  -*•  0  as  k  -*■  *.  Since 


e(k)  -  e  (t)Pe(t) 


Cfcfl  /Scfl 


.  t  kfl  T 

+  f  e  (T)Qe(x)dT 


this  implies  that  lim  e  (t)Pe(t)  •  0  and  the  Integral  in  (28)  tends  to  zero 

.kr*“  Ck 

as  k  -*•  Since  e(t)  is  uniformly  botmded  lim  e(t)  “  0. 

t-“  T 

Case  (ii) :  If  u  is  sufficiently  rich  over  any  interval  of  length  Tn|<n>  u(t)  -*•  0 
implies  ^  +  0  as  k  +  •, 

Case  (iii) :  For  the  case  where  u  grows  at  most  exponentially  we  prove  that 

T  T  A 

A  u(t)  -  o (sup  u(t)  ]  by  contradiction.  Defining  e  Pb  ■  e  (see  error  model  3) 

*  1 

(27)  may  be  written  as: 


T  1  ^lr4.1  f  k+l  m 

B1(t)Pe(t)|tr 1  +  j  ei(T)Qe(T)dx 

-  8(k)l|  f  e  (T)u( 
't.  1 


(T)u(T)dT 


where  8(k)  *  0,  k  e  N  and  8(k)  0  as  k  -*•  ®.  Let  $  (t)u(t)  +  o[sup|u(x)JJ  ] .  Then 

T  II 

we  can  denote Q  u(t)|J  »  0(sup|$  (t)u(t)  |  ].  In  such  a  case,  from  (23)  ft  e(t)||  and 

t*T 

U  u(t)l  grow  at  the  same  rate  and  equation  (29)  can  be  modified  to 

f  ^fc^l 

eT(tkfi)Fe(tfc4_i)  -  eT(tk)Pe(tk)  +  j  eT(t)Qe(r)dt 

;Vi  ,  k 


/  lcfl.  2 

-  8  (k)  f  e/(T)dx 

1  it  1 


where  8.  (k)  0  as  k  -*■  °*.  From  (30)  it  follows  that  the  sequence 

{eT(tfcfl)Pe(tfcfl)  -  +  0  as  k  +  *  and  f ^  e  COQeCOdt  +  0  as  k  +  «• 

Since  H  e(t)(\  can  grow  at  most  exponentially  the  latter  implies  that  e(t)  -*■  0  as 


t  -*■  »  which  contradicts  the  assumption  that  (I  e(t)|l  and  \\u(t)|\  grow  without  bound. 
Error  Model  3: 

The  third  hybrid  error  model  is  merely  a  special  case  of  the  second  error 
model  but  is  important  in  view  of  its  practical  applications  -  e.g.  adaptive 
control  of  a  plant  with  relative  degree  1.  It  is  described  by  the  scalar  differ¬ 
ential  equation 

ejCt)  -  -ae^(t)  +  [(p^uCt)  -  ye^O^COuCt) J 
if  approach  1  is  used  and  by  the  equation 

e^Ct)  »  -®e^Ct)  +  PfcTuCt)  C3 


W  (s)$  Tu(t)  -  o[sup  Uu(t)\^]  C35 

M  k  t>T 

y*>  ■  rH  • 

Comments: 

(i)  The  detailed  analysis  presented  in  this  section  is  based  on  the  conviction 


of  the  authors  that  efficient  design  methods  for  adaptive  systems  can  arise 
only  from  a  deeper  understanding  of  the  behavior  of  corresponding  error 


models.  For  esch  model  considered  three  specific  cases  have  been  discussed. 
The  first  two  assvme  that  the  input  u  to  the  error  model  is  uniformly 
bounded.  The  results  are  particularly  relevant  to  the  identification 
problem  where  the  plant  to  be  identified  is  assumed  to  be  stable  and 
the  input  to  the  plant  is  uniformly  bounded.  When  the  hybrid  adaptive 
algorithms  described  in  this  section  are  used  to  identify  such  a  plant, 
the  output  errors  will  tend  to  zero  and  the  parameters  will  tend  to  the 
true  values  if  the  input  is  sufficiently  rich.  The  error  model  used  and 
the  specific  algorithm  chosen  depend  upon  the  parametrizatlon  of  the  plant 
and  the  sampling  period  T. 

Cii)  The  main  result  of  this  section  is  relevant  to  the  control  problem  as 
well  as  identification  problems  where  the  vector  u  cannot  be  guaranteed 

to  be  uniformly  bounded  a  priori  (e.g.  the  parallel  model).  When  any 

T  T 

one  of  the  adaptive  laws  is  used  in  such  cases  u  (and  u  ln 

error  models  2  and  3)  is  shown  to  grow  asymptotically  at  e  rate  slower 

than  that  at  which  sup  ||  u(t)(  grows .  As  shown  ln  the  next  section  this 

t>T 

is  central  to  the  proof  of  global  stability  of  the  hybrid  adaptive  control 
problem. 

(ill)  The  two  approaches  used  to  develop  the  adaptive  algorithms  ln  the  three 

error  models  are  conceptually  different.  In  the  first  approach,  the 

discrete  Lyapunov  function  is  a  quadratic  form  ln  the  parameter  error 

vector  (model  1)  or  both  parameter  and  output  vectors  (models  2  and  3) . 

2 

The  direction  ln  which  At  is  adjusted  is  the  average  gradient  of  e^  (t) 

with  respect  to  $  over  an  interval  [t^»t^^) .  In  contrast  to  this  the 

2 

second  approach  attempts  to  minimize  the  Integral  of  a^  (t)  over  an 
Interval  so  that  At  is  the  gradient  of  this  performance  index.  As  seen 
from  the  simulation  results  in  section  4,  the  two  adaptive  algorithms 
lead  to  quite  different  responses  of  the  overall  system.  Approach  1 
is  found  to  be  more  effective  for  smaller  values  of  Tfc  while  approach  2 


Is  significantly  batter  when  is  large.  Using  the  saae  Lyapunov 
function  it  can  be  shown  that  a  convex  combination  of  the  two  adaptive 
laws  also  assures  the  boundedness  of  the  parameter  errors.  Hence  such 
a  combination  of  the  two  may  be  used  in  practice  to  realize  their 
combined  advantages. 

Civ)  As  in  purely  discrete  and  continuous  systems  the  adaptive  laws  in  hybrid 

systems  are  also  chosen  to  assure  that  the  parameter  vector  ♦  varies 

slowly  as  fc  -►  •  .  In  the  first  error  model  this  is  accomplished  using 

a  factor - -  ■  in  the  adaptive  law  (4)  in  the  first  approach  and  the 

1  +  u  u  . 

factor  ■  1  ■  ■  using  the  second  (12) .  The  feedback 

1  +  wT(k)w(k) 

term  in  (17)  serves  the  same  purpose  in  error  models  2  and  3  when  the 
first  approach  is  used  and  is  omitted  in  the  second  approach  where  a 

quadratic  factor  . .  ■  ■-  ■  is  used  (26) . 

1  +  w  (k)w(k) 

3.  Application.  Extension  and  Refinement: 

The  concepts  and  techniques  developed  in  section  2  find  wide  application  in 
adaptive  systems  where  practical  considerations  demand  a  hybrid  approach.  The 
swat  obvious  of  such  applications  is  the  design  of  stable  hybrid  adaptive  con¬ 
trollers  and  is  considered  in  section  3a.  The  same  concepts  can  also  be  extended 
to  discrete  systems  where  data  is  collected  at  a  faster  rate  than  that  at  which 
the  parameters  are  adjusted.  This  is  briefly  outlined  in  3b.  For  the  sake  of 
completeness  it  is  also  shown  in  section  3c  that  algorithms  of  an  integral 
type  [5]  suggested  for  continuous  systems  can  be  considered  as  natural  generali¬ 
zations  of  the  algorithms  developed  for  hybrid  and  discrete  systems.  Finally, 
well  known  methods  for  adjusting  the  adaptive  gain  matrix  in  a  time-varying  fashion 
e.g.  recursive  least-squares,  to  Improve  the  speed  of  response  can  be  readily 


extended  to  the  above  cases  end  are  discussed  in  3c. 
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a 


a)  Stable  Hybrid  Adaptive  Control: 


A  hybrid  adaptive  control  system  Is  one  in  which  a  plant  with  unknown  parameters 
which  operates  in  continuous  time  is  controlled  by  adjusting  a  controller  parameter 
vector  only  at  discrete  instants.  In  [10]  the  adaptive  law  (4)  was  used  to  demon¬ 
strate  the  global  stability  of  the  overall  system.  Similar  arguments  can  be  used 
to  show  that  all  the  other  adaptive  algorithms  in  section  2,  when  properly  applied 
also  result  in  global  stability.  For  single-input  single-output  systems  the 
adaptive  algorithms  generated  using  the  first  and  third  error  models  are  suitable; 
the  second  error  model  has  applications  in  multivariable  control.  In  this  section 
we  merely  outline  the  principal  steps  involved  in  the  proof  of  global  stability. 
a  linear  time- invariant  plant  with  unknown  parameters  is  to  be  controlled 

adaptively.  The  input  and  output  of  the  plant  are  u(*)  and  y  (*)  respectively 

P 

and  the  plant  transfer  function  W  (s)  is  rational  with  known  order  and  relative 

P 

degree  and  all  zeros  in  the  left  half  plane.  A  reference  model  has  a  stable 

rational  transfer  function  W  (s)  and  has  the  same  relative  degree  as  the  plant. 

n 

The  Input  r(*>  of  the  model  is  piecewise  continuous  and  uniformly  bounded.  The 
output  of  the  model  is  y  (•)  and  the  aim  of  adaptive  control  is  to  generate  an 

B 

input  u(*>  to  the  plant  using  a  differentiator  free  controller  so  that 
11m  |e  (t)  |  -  lim  |y  (t)  -  y  Ct)  |  -  0. 

t-*®  t-***  "  “ 

The  solution  to  this  problem  for  both  the  continuous  [1.2]  and  discrete  cases 

[3t4]  is  well  known.  In  the  former  using  the  input  u(*)  and  output  y  (•)  the 

P 

controller  generates  a  vector  of  sensitivity  functions  w(*)  so  that  the  input  u(*) 
to  the  plant  can  be  expressed  as 


6  Ct)wCt)  -  u(t) 


V  t  5  t. 


2qL1  ft 

where  in  general  8,  w:  ft  It  is  known  that  a  constant  vector  9  exists 

* 

such  that  when  eCt)  s  6  the  transfer  function  of  the  plant  together  with  the 


controller  Is  W  (a)  and  11a  e  (t)  •  0.  The  ala  of  the  adaptation  procedure  Is 
M  , -hip  X 

to  adjuat  0(t)  (and  hence  0(t))  continuously  so  that  this  asymptotic  behavior  is 
realized. 

In  the  hybrid  adaptive  control  problem,  the  controller  structure  is  identical 
to  that  used  in  the  continuous  case  but  the  parameter  vector  6(t)  is  adjusted 
only  at  discrete  instants  so  that 


6<t)  -  0, 


t  e  IWj) 


(37) 


k  e 


2«Ll  *  £ 

where  0fc  e  R  and  is  a  constant  vector.  If  0(t)  -  0  -  $(t)  the  parameter  error 


vector  <Kt)  is  also  piecewise  constant  and  0(t)  ■  4^  for  t  e  [t^.t^j)  where 


0^-0  ■  4^*  The  error  equation  for  the  control  problem  can  be  written  as 


l^(s)0T(t)wCt)  -  e1(t) 


(38) 


Special  cases  exist  for  the  control  problem,  as  for  example  when  W^fs)  is  a  strictly 


positive  real  transfer  function.  We  consider  below,  only  the  general  case  when 


Wg(s)  has  a  relative  degree  n  ;  2. 


To  generate  an  adaptive  law  for  adjusting  0(t),  an  auxiliary  signal  y#(0 


la  added  to  e^(0  where 


y4(t)  -  [0T(t)WM(s)I  -  WM(s)0T(t)]w(t) 


so  that 


*T(t)c(t)  -  ex(t)  +  y#(t)  -  e1(0 


(39) 

(40) 


where  e^(t)  Is  referred  to  as  the  augmented  error.  Using  the  observed  values  of 
e^(0  and  c(0  the  control  parameter  vector  0(0  (and  hence  0(0)  Is  adjusted  and 
it  is  than  shown  that  this  results  in  a  bounded  plant  output. 

In  section  2,  the  principal  result  of  the  analysis  was  that  the  adaptive  laws 


(4)  end  (12)  when  applied  to  equation  (40)  assure  that 


(41) 


e.(t)  ■  ♦  (t)C(t)  -  o[sup  \U(T)l|  ] 
A  t*T 


Further,  since  C(t)  ■  W^Cs)Iw(t)  and  4$(t)  -*■  0  as  t  -*•  "  it  can  be  shown  [10] 
that 


♦TCt)w(t)  -  *T(t)c(t)  +  o[sup  \\wCx)|| ] 

t*T 


(42) 


o[sup  ^w(t)|3 

t»T 


From  equation  (38)  it  follows  that  the  output  error  e^( •)  and  hence  the  plant  output 


J  (•)  can  grow  at  nost  at  a  rate  slower  than  sup\lw(T)|  which  in  turn  assures  their 


t*T 


boundedness. 


b)  Extension  fa  S vmtmm*  JCjjJg  Tun  Scales  i 

The  hybrid  error  models  described  in  section  2  can  be  considered  as  systems 
which  operate  on  two  tlae  scales  —  a  time  scale  associated  with  the  continuous 
time  functions  and  a  second  with  the  discrete  parameters.  Such  situations  also 
arise  frequently  in  purely  discrete  systems  where  the  inputs  and  outputs  are 
observed  at  a  certain  rate  but  the  control  parameters  are  adjusted  at  a  slower 
rate.  The  concepts  established  in  section  2  are  shown  in  this  section  to  carry 
over  directly  to  such  systems  also.  Further,  it  is  Interesting  to  note  that 
algorithms  recently  suggested  for  adjusting  control  parameters  in  continuous 
time  systems  [5]  can  be  interpreted  as  the  continuous  counterparts  of  such  die* 
crate  time  systems  operating  on  two  time  scales.  Hence  the  methods  suggested  in 
section  2  can  be  considered  to  provide  a  unified  approach  to  two  time  scale  prob¬ 
lems  in  discrete,  continuous  and  hybrid  systems. 

Cl)  Discrete  Tima  Models: 

The  first  error  model  corresponding  to  error  model  (1)  can  be  described  by 
the  equation 

♦.V  -  e.  k,  l  t  N,  It  [kT,(kfl)T]  ( 


where  ♦  is  a  constant  vs c tor  in  the  interval  [lcT, (lcfl)T]  .Using  approach  1  It  can 


be  shown  that  if  the  adaptive  law 


(kfl)T-l 


6  -  6  m  A  4  ■  i  r  — i— i -  m  _H  (*  ( 

*k  ?V  T  T  ltMr  ' 

1 *  *  *  i-kr  i  +  Ul u  *  * 

IT 

is  used,  V(k)  "  2  1*  *  Lyapunov  function.  This,  in  turn,  implies  Q  4^11  is 

bounded  iff  4  f  is  boundsd  and 

AV(k)  $  V(kfl)  -  V(k)  -  -  ♦  T[I  -  J  $  0  < 


which  yields 


-  0  IcH 


h  +  u^ 


Equation  (46)  assures  global  stability  of  the  adaptive  control  problem  when  the 
adaptive  law  (44)  is  used  to  adjust  the  control  parameters  in  a  discrete  adaptive 


system. 


Using  the  second  approach,  new  variables  c(k)  and  C(k)  are  defined  as 


(fcf  1) T-l  -  (fcfl)T-l 

E  e.  ■  c(k)  }  E  e.u,»  c(W 


and  the  error  model  (43)  can  be  expressed  as 


♦k  COO  -  *(W 


kcl 


The  corresponding  adaptive  law  is  given  by 


‘♦k- 


1  ♦  c  00(00 


id  assures  that  lim 


+  aiui 


The  other  adaptive  laws  for  the  discrete  error  models  corresponding  to  hybrid  error 
models  2  and  3  in  section  2  can  be  derived  in  a  similar  fsshlon. 


(11)  Continuous  Time  Models: 

In  the  continuous  time  error  aodel 


*  (t)u(t)  -  e^t) 


It  Is  well  known  thst  the  adaptive  law 


♦(t)  - 


1  +  uT(t)u(t) 


t  e  R 


results  In  a  bounded  paraaeter  error  vector.  Recently  other  continuous  adaptive 
lawa  have  been  suggested  (5]  which  utilize  past  Input-output  data  In  adjusting 
adaptive  paraasters.  He  shall  refer  to  such  adaptive  algorithm  aa  integral 
algorithm  In  contrast  to  the  point  algorltha  (51) .  By  a  proper  definition  of 
the  error  aodel  such  algorithm  can  ba  shown  to  be  generalisations  of  the  hybrid 
and  discrete  algorithm  developed  In  sections  2  and  3b. 

Let  the  unknown  paraaeter  error  vector  at  tlae  t  be  +(t)  and  let  the  output 
e^(*,*):R+  *  R+  R  be  defined  by 


♦  (t)u(r)  -  e^t.T)  t  <  t 


t,  t  e  R+. 


The  adaptive  law 


•-if 


i  r t  gtoPjCt,!) 


Jt_T  1  ♦  U  (Ou(T) 

which  uses  Input-output  data  over  the  Interval  [ t-T,t)  Is  a  generalisation  of  (44) 
for  the  discrete  case.  However*  unlike  the  discrete  algorltha*  (53)  poses  two 
mjor  difficulties  la  lapleaantation.  The  first  Involves  the  storage  of  the  values 
of  the  f taction  u(«)  over  the  Interval  of  Integration.  The  second  and  significantly 
greater  problem  Is  earned  by  the  fact  that  e^(t*t)  cannot  be  aaasured  directly  for 
use  la  the  adaptive  law  and  cannot  be  computed  from  equation  (53)  since  4(t)  Is 


-  *V' 


Tb«  above  problem  can  be  circumvented  by  noting  that  error  models  of  the  type 
(52)  arise  in  adaptive  situations  (as  described  in  section  3a)  where  a  parameter 

vector  8(t)  is  adjusted  and  has  to  evolve  to  a  desired  but  unknown  constant  vector 

*  * 

0  l.e.  0(t)  -  0(t)  -  0  • 

Bence  the  error  model  (52)  becomes 

[0(0  -  eVu(T)  -  SjU.T)  (54) 

or  0T(Ou(t)  -  y  (f)  ■  e.(t,T)  (55) 

fll  X 

where  y  (t)  Is  the  slgnel  produced  by  the  model  and  can  be  measured.  Hence  in  such 

B 

cases  the  adaptive  law  can  be  implemented  as 


♦(O  «  0(0 


1  ru<T>u^T>fl(t)  ~  uCOy^Ct) 

Tjt_TV  1+uT(Ou(t) 


As  mentioned  earlier,  the  implementation  of  (56)  is  rendered  difficult  by  die 

fact  that  the  values  of  u(a)  have  to  be  stored  over  a  window  of  length  T.  To  over* 

cone  this  problem  the  length  of  the  interval  T  is  increased  to  t  so  that  the  entire 

-q(t-T) 

past  data  is  used  but  a  weighting  factor  e  is  Included  to  assure  the  conver¬ 

gence  of  the  Integral.  Such  an  exponentially  weighted  adaptive  algorithm  has  the 


t_-/fc_.\f«<T)uT(T)0(t)  -  u(T)yJt) 


1  ♦  U  (t)u(T) 


which  can  be  conveniently  realized  by  the  matrix  differential  equations 


8(0  -  -R(t)  0  (t)  -  r(t) 


9(0  -  0 


1  ♦  u  (t)  u(t) 
«(Oy_(0 

-qr(t)  + - - 

1  ♦  u(t)u(t) 


The  adaptive  lav  (58)  is  precisely  the  one  suggested  in  [5]. 


In  conclusion,  the  approach  developed  in  section  2  is  seen  to  unify  discrete, 
continuous  and  hybrid  adaptive  algorithms  with  two  time  scales, 
c)  Adaptive  Gain; 

In  the  discussions  in  the  preceding  sections,  adaptive  gains  were  not  included 
In  the  adaptive  lavs  to  focus  attention  on  the  principal  results.  Experience  with 
complex  adaptive  systems  has  however  shown  that  the  speed  of  convergence  of  the 
algorithms  depends  critically  on  the  choice  of  the  adaptive  gains.  In  particular  a 
time-varying  gain  matrix  obtained  from  least-squares  considerations  is  found  to  be 
generally  acceptable  for  most  applications.  In  this  section  it  is  briefly  shown 
that  similar  time-varying  gain  matrices  can  also  be  included  in  the  hybrid  adaptive 
laws.  The  details  are  included  only  for  the  first  error  model.  Similar  arguments 
carry  over  to  the  other  error  models  also. 

If  the  first  error  model  is  described  by 


♦.  u(t)  -  e  (t) 
k  1 


'  *  (VW 


(59) 


let 


.  i  i_  { W1_  „T . 

'  Tk't.  1+uT(t)u(t) 


The  adaptive  gain  matrix  is  defined  by 


r:1.-  r:1  +  ^ 


fctl 


(60) 


and  the  adaptive  law  is  given  by 


r^rt-l  s,(t)u(t) 


r.  fTcfl  o.,(t)i 

“  T  * '  T 

k  *  tfc  1  +  U  < 


dt 


(t)u(t) 

For  the  system  described  by  equations  (59) ,  (60)  and  (61)  it  can  be  shown  that 


(61) 
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ls  a  Lyapunov  function  resulting  in 


AV(k) 


1  irtfcfl  *12(T)dT  ;tfcfl  e1  (t)uT(t) 

\  1  +  uT(t>u(t)  T  2  Jt  1  +  uT(t)u(t)  d 

k  k  k 

'rVl  «,(T)u(T) 

«  I  —4 —  * 

j  t  1  +  U  (t)u(t) 

%  J 


“1[1-rk\lrk 


5  0  If  I  -  r.  R  >  0 

k  k 


V  k  e 


From  163)  It  follows  that  5$.  (J  la  bounded  if  (I  ^  ||  Is  bounded,  A4  -*•  0  as  k  -*•  " 

rVl  a,  CO  *  0  k 

and  ■*  — —  -  dt  ■+■  0  as  k  “.  If  uC*)  grows  at  most  exponentially, 

1  +  uCOuCO 


;tk  1  +  u  (t)uCO 

the  last  result  lap  lies  that  a  (t)  *  o[supUu(t)QJ . 

1  tiT 

4 .  Simulations: 

The  error  models  described  in  section  2  and  their  applications  described  in 
section  3  have  been  simulated  extenalvely  on  the  digital  computer.  We  include  in 
this  section  four  typical  examples  which  compare  the  effectiveness  of  the  two 
adaptive  approaches  proposed  in  section  2.  In  all  cases  the  parameters  are  ad¬ 
justed  periodically  with  a  period  T,  so  that  tfc  ■  kT  (k  e  B).  The  aain  interest 
in  these  simulations  is  on  the  effect  of  T  on  the  speed  and  accuracy  of  the 
responses. 


Example  1:  The  first  hybrid  error  model,  described  by  the  equation  CD  was  slant- 

2 

lated  when  u(t) ,+(t)  c  R  and  the  input  vector  u  is  defined  by 
UjCt)  -  sln(.75t)  u2(t)  -  sln(2.6t) 

Figures  la-ld  show  the  evolution  of  the  output  error  e^(t)  and  the  parameter  error 

vector  +(t)  when  approaches  1  and  2  are  used.  In  Figures  la  and  lb  T  -  0.5  while 

T  •  5.0  in  Figures  lc  and  Id.  Approach  1  rasults  in  rapid  convergence  of  e^(t)  and 

4(t)  for  T  ■  0.5.  In  contrast  to  this  the  convergence  is  very  slow  when  approach  2 

A  r  kf  1 

is  used.  This  may  be  attributed  to  the  fact  that  w(k)  -  j  e^OOuCOdt  does  not 

*k 


vary  adequately  over  an  interval  when  the  period  T  is  saall.  As  T  is  Increased 
the  response  using  the  first  approach  deteriorates  while  that  using  the  second 
approach  lap roves  markedly.  With  T  *  5  it  is  seen  that  $  decreases  to  a  value 
close  to  zero  at  the  end  of  one  period. 

1«  2:  Figures  2a-2d  show  the  evolution  of  e^(t)  and  <Kt)  when  the  same 
experiments  as  in  example  1  were  performed  on  error  model  3.  The  basic  features 
of  the  responses  using  the  two  approaches  remain  the  same  Indicating  that  the 
approach  rather  than  the  specific  error  modal  chosen  governs  the  behavior  of  the 
transient  response. 

Example  3:  In  this  example,  all  the  signals  of  Interest  are  discrete,  though 
input  and  output  are  defined  for  all  k  e  1  and  the  parameter  error  vector  is 


adjusted  periodically  with  period  T  c  H.  In  the  second  order  system  simulated 

u^(k)  -  sin(.OSk)  u^lt)  -  sin(.251c) 

The  adaptive  law  used  in  this  case  to  adjust  Ad  had  the  fora 


Ad(k)  -  SA^OO  ♦  Cl-«)Ad2(k) 


0  f  «  f  1 


where  Ad^Ck)  and  AdgCk)  are  the  adaptive  laws  given  by  the  two  approaches.  As 
■ight  be  expected  6  W  1  for  small  values  of  T  and  6  9*  0  for  large  values  of  T 
are  found  to  be  setisfaetory  as  seen  in  Figure  3a- 3d. 

The  behavior  of  the  error  model  when  the  input  grows  at  most  exponentially 
has  keen  stressed  throughout  the  paper.  In  particular  the  main  result  of  section  2 
was  that  in  such  a  case  the  output  error  would  grow  at  most  at  a  slower  rate  as 
compared  to  the  input.  The  experiments  in  this  example  were  perforned  to  verify 
this  result.  If  u(t)  has  the  fora 


Ujtt)  •  e’4tain(.75t) 
UjCt)  •  e'4tein(2.6t) 


it  is  seen  from  Figure  4a-4b  ^  +  0  as  k  >  •  so  that  e^(t)  -*•  0  as  t  -*■  ®.  In 

this  case  u  grows  in  an  unbounded  fashion  but  is  sufficiently  rich.  However, 
when  only  the  first  component  u^t)  of  u(t)  grows  exponentially,  does  not 
tend  to  zero  but  asymptotically  approaches  a  constant  value  orthogonal  to  the 
vector  [1,0].  This  cam  be  seen  in  Figure  4c-4d. 
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Evolution  of  e.(t)  and  +(t)  -  Error  Model  3 
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Response  of  error  oodel  1  with  exponentially  growing  input. 


